Newton-like Method with Diagonal Correction for Distributed Optimization
نویسندگان
چکیده
منابع مشابه
Newton-like method with diagonal correction for distributed optimization
We consider distributed optimization problems where networked nodes cooperatively minimize the sum of their locally known convex costs. A popular class of methods to solve these problems are the distributed gradient methods, which are attractive due to their inexpensive iterations, but have a drawback of slow convergence rates. This motivates the incorporation of second-order information in the...
متن کاملAdaptive Newton - like method for shape optimization
Abstract: The aim of this work is to introduce an adaptive strategy to monitor the rate of convergence of a Newton-like method in numerical shape optimization. Such superlinear iterative algorithms are often computationally intensive and the rate of convergence depends on how accurate the numerical solution of the state equation is. The model concerns a cost function depending on the unknown do...
متن کاملA Distributed Newton Method for Large Scale Consensus Optimization
In this paper, we propose a distributed Newton method for consensus optimization. Our approach outperforms state-of-the-art methods, including ADMM. The key idea is to exploit the sparsity of the dual Hessian and recast the computation of the Newton step as one of efficiently solving symmetric diagonally dominant linear equations. We validate our algorithm both theoretically and empirically. On...
متن کاملGIANT: Globally Improved Approximate Newton Method for Distributed Optimization
For distributed computing environments, we consider the canonical machine learning problem of empirical risk minimization (ERM) with quadratic regularization, and we propose a distributed and communication-efficient Newton-type optimization method. At every iteration, each worker locally finds an Approximate NewTon (ANT) direction, and then it sends this direction to the main driver. The driver...
متن کاملOptimization flow control with Newton-like algorithm
We proposed earlier an optimization approach to reactive ow control where the objective of the control is to maximize the total utility of all sources over their transmission rates. The control mechanism is derived as a gradient projection algorithm to solve the dual problem. In this paper we extend the algorithm to a scaled gradient projection. The diagonal scaling matrix approximates the diag...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: SIAM Journal on Optimization
سال: 2017
ISSN: 1052-6234,1095-7189
DOI: 10.1137/15m1038049